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We use scaling results to identify the crossover to mean-field behavior of equilibrium statistical 
mechanics models on a variant of the small world network. The results are generalizable to a wide- 
range of equilibrium systems. Anomalous scaling is found in the width of the mean-field region, as 
well as in the mean-field amplitudes. Finally, we consider non-equilibrium processes. 



The appropriate description for many complex real- 
world systems is as a network [1], a general connection of 
nodes and vertices which need not have the structure of 
a regular lattice. The small-world network model com- 
bines both long-range and short-range aspects, and in- 
terpolates between regular lattices and random graphs. 
This model [2], in which a regular lattice is modified by 
either randomly "re-wiring" links or else by simply ran- 
domly adding long-range links, has become a standard 
model of real-world networks. It incorporates some no- 
tion of locality, as most of the links remain the same as 
that of the original underlying lattice. Yet it also includes 
the "small world effect" , that the average path length be- 
tween sites on the network scales only as the logarithm 
of the network size. 

Cooperative behavior on networks is a major topic of 
interest. Studies of equilibrium statistical on these sys- 
tems have shown rich behavior [3-6]. Work [7,8] on net- 
works with long tails in the probability distribution of the 
coordination number has found alternatives to mean-field 
behavior. We will instead study the behavior on small- 
world systems. The technique will be generically applica- 
ble to a wide-range of problems. We show the existence 
of mean-field behavior, albeit with anomalous exponents 
describing the width of the critical region and various 
mean-field amplitudes. These anomalous exponents can 
complicate the interpretation of numerical data. Finally, 
we will consider a non-equilibrium case, describing the 
relaxation to a stationary state via a branching process. 

The presence of quenched randomness makes the 
small-world model difficult to treat analytically. We in- 
stead consider a different, but related model, which lacks 
quenched randomness, considering a variety of equilib- 
rium and non-equilibrium models. We again start with 
a regular lattice of V sites in d dimensions. Rather than 
adding long-range links with probability p, we give each 
site of the lattice a weak coupling, of order p/V, to ev- 
ery other site in the lattice [9]. We will refer to this as 
the long-range model. We will find that many results 
can be obtained on this system by combining mean-field 
with standard renormalization group techniques. Later, 
we will compare this model to the standard small world 
model; we will argue that in many cases the presence of 
quenched randomness in the small world model is irrele- 
vant, and thus scaling results for the small world model 



can be obtained from the long-range model. It is interest- 
ing to compare to a related mean-field solution of path 
lengths on a small work network [10]. Finally, we will 
show the long-range model provides an upper bound for 
the free energy of the small world network model. 

In some cases, the long-range model may also be more 
appropriate than the usual small world model. In the 
spread of a disease, for example, people tend to spread 
the disease to those geographically nearby (the regular 
lattice). There is a chance of a long-range spread of the 
disease. However, this is not necessarily due to fixed long- 
range links. Rather, it is due to the random probability 
that a given person travels a long distance, typically by 
air. Thus, a slight probability of long-range contact be- 
tween any two people may be a better description than 
a set of fixed long-range links. 

Equilibrium Statistics — We consider any equilibrium 
statistical mechanics model, such as an Ising model, XY 
model, etc... These models can be represented by intro- 
ducing a field 4>{x) , where x labels lattice sites and where 
4> has 1,2,... components, with a partition function 

Z = ^cxp[-5[0]], (1) 

where S = E/kT is a statistical weight for a configuration 
of energy E at temperature T. 

For a model on a regular (i-dimensional lattice, S[cj>] — 
Siocail^], a local function of <j>. We refer to this as the 
local system. We choose instead for the long-range model 
a statistical weight with additional long-range couplings 
of strength p/V: 

S[4>] = SfccdM ~ ^7 E ^ ■ ( 2 ) 
Then, decouple the long-range interaction to find 

Z= I dh exp[-^-]Z(h), (3) 

— OO 

where 

Z(h) = £exp[-Si oca i[<fl +hJ2<t> x }- ( 4 ) 
{0} 
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Here, Z(h) is equal to the partition function of the local 
system in the presence of a magnetic field, h. 

For p large, the long-range interaction outweighs the 
short-range interaction, and the system can be approxi- 
mately solved by mean-field theory. We will instead con- 
sider precisely the opposite case: when p is small. Then, 
the critical point of the long-range system, T c , is close to 
the critical point of the local system, T c . Thus, we can 
use scaling laws for the local system: the magnetization, 
to, obeys m(T — T c ,h) — ^4 m |ft,| 1 /' 5 , defining the criti- 
cal exponent 5. For T > T c , the susceptibility \ obeys 
x(T,h = 0) = A+\T — T c |~ 7 . In general, we can write 
a scaling function: to = h^ s f((T - T^ft-VW)). For 
h» (T - T C ) 5 P, we use the first result m(T = T c , h) = 
A^hl 1 / 5 , while for h « (T - T C ) SI3 , we use the second 
to(T = T c ,h) = A+h\T -T c |-t - B x h 3 \T - T c \-"<- 25t) , 
where we have added the ft. 3 term in the expansion of to. 

The magnetization is defined by d\nZ(h)/dh = mV. 
Thus, 



n 

Z(h) = Z(0)cx P [ J dh'm(h')V]. 



(5) 



We start by considering the case of T near T c so that 
h» (T - T c ) <5/3 . Then, Eqs. (3,5) give 

Z = Z(0) j dh C xv[-^-+A m Vh 1+1 / 5 /(l + l/6)}. 

— oc 

(6) 

Since V is taken large, we can use a saddle point to arrive 
at h= (Mm) 5/(5 - 1} , or 



to = A m (pA m ) 



1/(5-1) 



(7) 



The correlation length £ of the local system in the pres- 
ence of this field is proportional to mT v ^ \ and hence 
diverges as p — > 0. The meaning of the correlation length 
is not that spins beyond this length arc uncorrelated. 
Rather, it is that beyond this length the correlations in 
the long-range system are controlled by the average field 
to, while below this length, the fluctuations arc impor- 
tant. Thus, the correlation function (<p(0)(f>(x)) decays 
as a power law up to the correlation length, and then 
asymptotes to a constant. 

We have seen that at T = T c , the system has a net 
magnetization, and thus T c < T c . To study the transition 
itself, we now consider the second case, h « (T — T C ) 5 P . 
Now, Eqs. (3,5) give 

Z = Z(0) J dhcxp[-^+A+Vh 2 \T-T c \-y2 (8) 

— oo 

-B x Vh 4 \T -T c |-t- 2 ^/4]. 



Again using a saddle point, we find a critical point at T c 
given by 

f c -T c = {pA+fl\ (9) 

with to = for T > T c . Slightly below the critical point 
wc find h = \[T C - T\j^{T c - T c )^-V2 5 an d a mag- 
netization given by 



to = V^c - TA+J^L(f c r c )^-V2-7 (io) 



^/f c -TA+J^(f c -T c f-^. 



Thus, the magnetization behaves as to = AVf c - T, 
If the local system is described 



with A 



oc p 



(0-l/2)/7 



by mean-field theory, then (j — 1/2 = 0. In other cases, 
[3 < 1/2, and the mean-field amplitude A diverges for 
small p. From Eq. (8), the specific heat jump at T = T c 
is equal to { 1 A+\f c ^T c \--<- 1 ) 2 /{2B x \f c -T c \-^- 2S f 3 ) oc 
\f c -T c \ 2Sl3 -^- 2 = \ f c -T c \- a . Thus, the jump in specific 
heat at the mean-field transition is of order the specific 
heat of the local system at temperature T c . 

We now consider the width of the mean-field critical 
region. If we extrapolate Eq. (10) to T = T c , we find 
that the power of p in the result is consistent with the 
power of p in Eq. (7). For T < T c , the average mag- 
netization of the local system in the absence of a field 
behaves as \T C — T\@, and the susceptibility is given by 
X = A~\T C — T|~ 7 . In the long-range system, this mag- 
netization produces a field h oc p \T C -T\P, which in turns 
feeds back and increases the magnetization an amount of 
order p\T c - Tp|T c - T\~i . For \T C - T| 7 >> p, this 
effect is negligible compared to the averaged field itself, 
\T C — T\P . Thus, at such temperatures the long-range 
interactions have negligible effect on the magnetization 
and so the mean-field critical behavior only extends to 
\T C — T\ oc p 1 / 7 oc \T C — T c \. Therefore, for small p, 
the width of the mean-field critical region is small. The 
scaling arguments above all rely on this width becoming 
narrower than the width of the anomalous critical region 
in the local system, in which case both mean-field and 
anomalous scaling will be seen in the same system. 

Effect of Randomness- We now consider the difference 
between the long-range model, which lacks randomness 
and has links of strength p/V , and a version of the small- 
world model in which the local network is modified by 
adding strong links connecting sites with a probability 
p/V. The strategy is to consider the system without 
randomness, and to consider the effects of randomness 
as a perturbation. We verify that it is self-consistent to 
ignore randomness, at least for small p. 

At T c , the correlation length of the local system is £ oc 
(T c — T)~ v oc p^'^ 1 . Thus, within a correlation volume, 
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there are p~ vd l^ sites. The correlation volume can be 
characterized by the average field acting on it, and the 
average temperature of the correlation volume. 

First consider the average field. If sites in the corre- 
lation volume are chosen instead with probability p to 
have long-range links, then an average of p 1 ~ lJd /~t sites 
are chosen. Since 1 — vd/^f < 0, this number diverges 
as p — > 0. Then, there are a large number of such sites 
within each correlation volume and so the fluctuation in 
the number of such sites within each correlation volume 
is negligible. Thus, the fluctuation in the average field is 
negligible. 

Now, consider the average temperature. A site that 
is coupled via a long-range link has reduced correlations 
with its neighbors compared to one which does not have 
such a link. The site it is coupled to via the long-range 
link produces an average field proportional to to, and 
also produces fluctuations about this field. Thus, effec- 
tively the temperature of a site with a long-range link is 
raised, as the fluctuations in the field reduce its corre- 
lations with its neighbors. Consider the number of sites 
with long-range links. The root mean square fluctua- 
tion in the number of such sites scales as (p^) 1 / 2 , and 
thus the fluctuation in the temperature averaged over a 
correlation volume scales as {p/S, d ) 1 ^ 2 oc p 1 / 2+l " 1 /^) oc 
\f c - T c \^/ 2 - vd / 2 . Compare this to the difference in tem- 
peratures, T c — T c . As long as 

7/2 + i/d/2>l, (11) 

the fluctuation in temperature is also negligible. Eq. (11) 
resembles the Harris criterion [11] for the relevance of 
disorder, with an additional term 7/2 on the left-hand 
side. This additional term guarantees that the inequality 
holds for all models that we know. Thus, fluctuations in 
field and temperature are both negligible and the scaling 
of both T c — T and A with p should be the same in the 
small-world and long-range models. 

Variational Approach — In addition to the scaling ar- 
guments above, we now show that the long-range model 
without randomness provides an upper bound to the free 
energy of a small world network model, using an ar- 
gument inspired by the Migdal-Kadanoff bond-moving 
procedure [12]. Eq. (2) defines the statistical weight S 
without randomness. If instead of connecting every pair 
of sites with strength p/V, we add connections between 
pairs of sites with probability p/V and unit strength, we 
obtain a new statistical weight 

S[<t>] = S local [cf>} - \ 0(*i) • <f>(X2), (12) 

Xl,X2 

where the sum extends over sites Xi,x 2 which are 
connected by a long range link. Then, (S — S) = 
x 2 x 2){<f>{xi)(j)(x2)) 7 where the brackets () de- 

note an expectation value computed with statistical 
weight e _s , and where w(x\,X2) = —p/(2V) if x\,X2 



are not connected in the small world network and 
w(x\,x 2 ) = 1 —p/(2V) if xi,X2 are connected. The 
quantity (S — S) is a random function of disorder. How- 
ever, for a large system, this quantity is self-averaging. 
If pairs are connected with probability p/V, the average 

over disorder, (S — S), is equal to zero. Thus, for typi- 
cal networks, (S — S) = 0, up to small fluctuations, and 
thus by a convex inequality, Z typ > Z, where Z typ is the 
partition function for a typical small world network, with 
statistical weight e~ 5 . 

This shows that the free energy of such a small world 
model is less than or equal to the free energy of the long- 
range model. Intuitively, we expect that the transition 
temperature in the long-range model will be higher than 
that in the small- world model: if we ignore the local cou- 
plings, and consider only the long-range links then this 
statement is definitely true. Above we have argued that 
T c — T should scale as the same power of p in both the 
small-world and long-range models. Even if that argu- 
ment were to break down, we should expect that T c — T c 
scales as at least as large a power of p in the small- world 
model as it does in the long-range model. 

Comparison to Numerics — An important work was a 
numerical calculation of some of these quantities, looking 
for the shift in the transition temperature [6] . In that pa- 
per, a different scaling argument was made for the shift, 
f c -T c ~ pVM). This is the temperature at which a 
correlation volume includes roughly one long-range link. 
However, we have argued that the shift in transition tem- 
perature actually scales as p 1 / 7 , which is less than p x l ^ d ^ 
as p — > 0. The difference arises since one long-range link 
is not sufficient to magnetize an entire correlation vol- 
ume; several such links are required. 

The numerical results in two dimensions are consis- 
tent with a shift in transition temperature scaling as 
p 1 /i = p0.57..._ nume rical results in three dimensions 
indicate a shift scaling as p - 96 , while taking 7 = 1.2396 
from e-expansion [13] gives I/7 w 0.81. This indicates 
some discrepancy with the numerical results. However, 
in the numerical study [6], it was argued that their re- 
sults do not yet involve sufficiently large lattices to obtain 
accurate scaling; certainly, p 81 is closer to the observed 
scaling than p 1 /^) w p - 53 is. 

Non-Equilibrium Dynamics — We now consider the 
generalization to a non-equilibrium process, the contact 
process [14], in which each site is marked either infected 
or susceptible. An infected site becomes susceptible at 
unit rate, while an infected site can turn a neighboring 
susceptible site infected at a rate X/q, with q the lattice 
coordination number. The state with all sites suscepti- 
ble is absorbing. However, above a critical A c , if a single 
infected site is placed in an infinite lattice of susceptible 
sites, there is a non-zero probability of the epidemic per- 
sisting for all time. We modify the model as follows: each 
susceptible site can be infected by any other infected site, 
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not necessarily a neighbor, at a rate equal to p/V. Al- 
though we will not decouple this interaction, the general 
development will be very similar to the equilibrium case. 

We start by recalling some exponents in the local case. 
For A > A c , there is an average density, p oc |A — A c |^. In 
the presence of a source, where susceptible sites become 
infected at a rate h, the density p(A = A c , h) = A p h}/ Sh . 

Consider also the infection spreading from a single 
source. At A = A c , the survival probability of the in- 
fection after time t, P(t) obeys P(t) = A p t~ s , The num- 
ber of infected sites is a random variable, n(t); the av- 
erage number of such sites obeys n(t) = A n t n . The 
radius of the infection scales as t z l 2 . For A < A c , the 
infection dies out exponentially, with an asymptotic sur- 
vival probability P(t) oc e~*/ T , with t oc |A C - \\~ v w . 
This gives rise to a divergent susceptibility: in the pres- 
ence of a source h, the susceptibility, \ = dh,p, obeys 
X (A,/ l = 0) = ^|A c -A|-T. 

Now, consider the dynamics in the long-range model, 
with A = A c , with a single source for an infection. This 
source grows as described, with the given P(t),n(t). 
However, the local outbreak starting from that source can 
produce other local outbreaks elsewhere, via the long- 
range links, at a rate equal to p times the number of in- 
fected sites. For p small, the number of infected sites n(t) 
will be large before such an event, and thus the fluctua- 
tions in the n(t) are described by a random process with 
a universal distribution. In the large V limit, at fixed t, 
each new local outbreak produced via a long-range link 
is well separated in space from the other local outbreaks. 
Thus, we can describe the dynamics of the spread from a 
single source simply: there is initially one local outbreak, 
created at time 0, which survives at time t with probabil- 
ity P(t), and which produces additional local outbreaks 
at a rate equal to pn(t). Each local outbreak, created at 
time t' , evolves independently, surviving with probabil- 
ity P(t — t'), and producing additional local outbreaks 
with rate pn(t — t'). This fully describes the dynamics 
via a branching process. For A =/= A c , this description 
of the dynamics remains valid with a changed P(t) and 
distribution of n(t). 

At short times, the average number of infected sites in 
this dynamics is equal to n(t). At long times, the av- 
erage number of infected sites grows exponentially. To 
describe this exponential growth, realize that at long 
times the number of local outbreaks becomes large. If 
s(t') describes the number of local outbreaks started at 
time t', then the average number of particles at time t is 
equal to J Q dt' s(t')n(t — t'), and thus on average s(t) — 
p Jq dt' s(t')n(t — t'). Inserting an ansatz s(t) = e at , we 
find that 

a =[A ri pT{l + f 1 )] 1 ' { - 1+r >\ (13) 

Each local outbreak takes a volume of order t dz l 2 . 
Eventually, at sufficiently large time, such that e at ~ 



(V/t dz / 2 ), the individual local outbreaks start to merge, 
and the dynamics of different local outbreaks become 
coupled. This time t is of order ln(V). 

Beyond this time t, one approaches a stationary state 
with density p. At A = A c , the dynamics is equivalent 
to the local system with a source of particles h = pp. 
Thus, we find that the density obeys h = pA p h Y l &h , or 
h = (pA p ) Sh ^ Sh - 1 '> and thus 

P = A p {pA p f/^- 1 \ (14) 

Eq. (14) should be compared to Eq. (7). It implies 
that the transition to a spreading epidemic happens at 
A = A c < A c . For A w A c , following the same steps as in 
the equilibrium case leads to the same result as Eq. (10), 
except that the role of temperature T is replaced by A, 
and the role of magnetization m is replaced by density p. 
The transition is again mean-field. Thus, the stationary 
results in this non-equilibrium model are described by the 
same scaling theory as in the equilibrium models, while 
the spread of infection starting from a single source is 
described by an interesting branching dynamics. 

Discussion — We have developed a general scaling the- 
ory for describing equilibrium and non-equilibrium sys- 
tem with both short and long-range interactions. We 
find that the long-range interactions lead to mean-field 
behavior, but with a scaling region whose width vanishes 
as p — > 0. We have also developed a branching process 
description of the spread of infection from a single source 
in the contact process with long-range interactions. 
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